Software test results exploration and visualization with continuous integration and nightly testing

Abstract Software testing is key for quality assurance of embedded systems. However, with increased development pace, the amount test results data risks growing to a level where exploration and visualization are unmanageable. This paper covers tool, Tim, implemented at company developing systems, software occurs in parallel branches nightly partitioned over branches, systems cases. Tim aims replace previous solution problems scalability, requirements technological flora. was reference group several months. For validation, were collected both from meetings logs usage tool. Data analyzed quantitatively qualitatively. The main contributions study include implementation eight views visualization, identification four solutions patterns these (filtering, aggregation, previews comparisons), as well six challenges frequently discussed (expectations, anomalies, navigation, integrations, hardware details plots). Results put perspective related work future proposed, e.g., enhanced anomaly detection integrations more such risk management, source code repositories.